3D COLOR INFORMATION ACQUIRSITION METHOD AND 3D COLOR 
INFORMATION ACQUISITION DEVICE 



BACKGROUND OF THE INVENTION 

5 Field of Invention 

The present invention relates to a 3D (three dimension) color information acquisition 
method and a 3D color information acquisition apparatus for use in 3D model imaging with 
high resolution. More particularly, the present invention relates to a 3D color information 
acquisition method and apparatus using more than 3 of major colors to encode a pattern and 
1 0 increase image resolution with a considerable reliability. 

Related Art 

Many 3D image acquisition methods have been provided in the prior art. One approach 
uses laser to scan topography of an object placed inside a box and to acquire colors of the 
15 object. Such a method requires expensive equipment and is time-consuming, which is not 
very practical in use. Another approach is to project a pattern in the form of color bands or 
color blocks on an object. A location of every color band or block is determined and 
compared to that of a reference pattern. Depth data of the object are calculated by using 
triangle distance measurement. 

20 The profile, texture and material greatly affect the data acquisition for the object. 

Usually, the number of major constituting colors is 3 or 4 in view of stability. If the number 
of major constituting colors is higher than 4, then it is difficult to recognize the colors of the 
object when the pattern is projected on the object. If the number of major constituting colors 
is lower than 3, then this type of method is not suitable for use in encoding a large-size and 

1 



high-density object image. It is an important issue to balance the resolution and the stability. 

WO 00/70303 uses three basic colors, i.e., Red, Green, and Blue for color encoding. US 
2002/0075456 uses four basic colors for color encoding. When the number of basic 
constituting colors is small, the total number of encoded color bands is small. In WO 
5 00/70303, the number of encoded color bands is less than 100, while in US 2002/0075456 it 
is less than 64, which are not enough for the requirement of resolution in the current color 
image field. WO 00/70303 further teaches forming a redundant pattern at a center of the 
pattern to increase the number of encoded color bands, with a black region between two 
adjacent color bands. US patent No. 6549288 uses gradual variation in intensity of light to 
1 0 form structured light pattern. However, the redundant pattern may disappear due to unknown 
reasons, which causes encoding failure. Furthermore, the color bands are greatly influenced 
by the object conditions. Reducing color gradation may constitute a solution to satisfy the 
resolution requirement, but it only partially solves the problem. 



1 5 SUMMARY OF THE INVENTION 

It is therefore an object of the invention to provide a method of acquiring 3D color 
information and a 3D color information acquisition device that can increase the resolution of 
a 3D model and prevent color distortion caused by color pattern projection, thereby 
increasing the reliability and broadening the application of the color acquisition device. 

20 The 3D color information acquisition method uses a common light source and a pattern 

light source to respectively acquire a texture image and a pattern image. The pattern image 
consists of more than 3 basic colors. The texture image is used to analyze the color 
composition of an object. Locations of color strips of the pattern light source 
correspondingly in the pattern image are calculated by boundary detection. The color of the 

25 pattern image relative to the pattern light source is determined and corrected to obtain data for 
the profile of the object. The 3D model of the object is calculated from the color composition, 
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the topography and the profile data of the object. 

The 3-D color information acquisition device of the invention includes a pattern light 
source, which provides a pattern image consisting of more than 3 basic colors. More than 3 
basic colors increase the resolution and analysis reliability of color composition and 
5 combination. 

Further scope of applicability of the present invention will become apparent from the 
detailed description given hereinafter. However, it should be understood that the detailed 
description and specific examples, while indicating preferred embodiments of the invention, 
are given by way of illustration only, since various changes and modifications within the 
10 spirit and scope of the invention will become apparent to those skilled in the art from this 
detailed description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will become more fully understood from the detailed description 
15 given herein below illustration only, and is thus not limitative of the present invention, and 
wherein: 

FIG. 1 is a schematic view of a 3D image acquisition apparatus according to one 
embodiment of the invention; 

FIG. 2 is a flow chart of a pattern encoding process according to one embodiment of the 
20 invention; 

FIG. 3 is a flow chart of a 3D- information acquisition process from an object image 
according to one embodiment of the invention; 

FIG. 4 is a flow chart of a boundary detection process according to one embodiment of 
the invention; 
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FIG. 5 is a schematic view of pattern image conversion coordinates according to one 
embodiment of the invention; 

FIG. 6 is a schematic view illustrating trough calculation according to one embodiment 
of the invention; 

5 FIG. 7 is a flow chart of a pattern image color correction process according to one 

embodiment of the invention; 

FIG. 8 is a schematic view of a cluster combination performed according to one 
embodiment of the invention; 

FIG. 9 is a schematic view illustrating the arrangement of pattern locations; 

10 FIG. 1 0 illustrates an arithmetic of color evaluation; and 

FIG. 1 1 is a schematic view showing encoding locations. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring to FIG. 1, a 3-D color information acquisition apparatus includes an image 
15 pickup device 102, an overhead flash 103 and a switch module 104. The image pickup 
device 102 further has a laser-positioning device 101 to evaluate a distance between the 
image pickup device 102 and a target object which image has to be taken. The locations of 
two laser points are adjusted to superimpose each other at a distance L from the image pickup 
device 102. If the Lvalue is smaller, then the image acquisition range is smaller. IfLvalueis 
20 greater, then the image acquisition range is larger. The image pickup device 102 may be, for 
example, a digital camera or a color CCD camera. The overhead flash 103 emits white light 
by a white light source 106 at a first shot. Before a second shot, the switch module 104 
switches to a pattern light source from the white light source 106. The pattern light source 
includes an overhead pattern projector 105 (such as a flash) and a pattern film slide 107 to 
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project the pattern light on the target object. 



The pattern of the invention is encoded by more than three colors. In a preferred 
embodiment of the invention, the pattern of the invention is constructed by 6 colors, i.e., Red 
(255, 0, 0), Green (0, 255, 0), Blue (0, 0, 255), Cyan (0, 255, 255), Magenta (255, 0, 255), 
5 Yellow (255, 255, 0) to increase the image resolution and reliability of image analysis. Each 
of the colors is arranged orderly according to the sequence as listed in Table 1 . For example, 
a Red color is followed by a Green, Blue and Cyan one, and a Green color is followed by Red, 
Blue and Magenta. 

Various arrangements of the above colors generate N pattern strips, wherein N is usually 
10 384 or 512, maximum 1024. Each pattern strip includes a plurality of encoding units for 
identification. In one embodiment of the invention, each encoding unit includes six colors 
sequentially listed from top to down of Table 1 . Therefore, there are totally N-5 encoding 
units. Each encoding unit has a unique code to identify the location of the pattern strip. 



Current color 




Allowable adjacent color 






1 


2 
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R (255,0,0) 


G (0,255,0) 


B (0,0,255) 


C (0,255,255) 


G (0,255,0) 


R (255,0,0) 


B (0,0,255) 


M (255,0,255) 


B (0,0,255) 


R (255,0,0) 


G (0,255,0) 


Y(255,255,0) 


C (0,255,255 


R (255,0,0) 


M (255,0,255) 


Y(255,255,0) 


M (255,0,255) 


G (0,255,0 


C (0,255,255) 


Y(255,255,0) 


Y (255,255,0) 


B (0,0,255) 


C (0,255,255) 


M (255,0,255) 



Table 1 
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FIG. 2 illustrates a flow chart of a process of generating a pattern. First, a primary 
encoding unit is manually selected (step 201). One of the basic colors is added behind the 
primary encoding unit including the last continuous six color elements (step 202). It is 
confirmed whether the arrangement of the color elements of the new color strip follows the 
5 color sequence as listed in Table 1 (step 203). If yes, this arrangement of color elements is 
designated as a new encoding unit (step 204). It is then checked whether the new encoding 
unit has occurred beforehand (step 205). If yes, then another color is selected (step 210); 
otherwise it is determined whether the new encoding unit belongs to one of the existing 
clusters (step 206). Table 2 and FIG. 8 illustrate the definition of a cluster. There may be 

10 erroneous color evaluation due to mathematical calculation imprecision. The mathematical 
calculation is illustrated in FIG. 10. All the encoding units erroneously and correctly 
evaluated are collected in one cluster. Erroneous color evaluation possibly happens in one 
cluster, while it is impossible to identify one encoding unit of one cluster as the encoding unit 
of another cluster erroneously. By locating each encoding unit within a specified range, any 

1 5 superimposition of the encoding units is prevented, correct identification of the encoding 
units can be thereby achieved. 

If the encoding unit belongs to one of the existing clusters, then it is put in that cluster 
(step 208). It is then checked whether the encoding unit in question is spaced from other 
encoding units in the same cluster at a distance greater than a predetermined value (step 209). 
20 If not, then one of the basic colors is selected again (step 210). If the encoding unit in 
question does not belong to any of the existing clusters, then a new cluster is generated (step 
207). The above steps are repeated until no new color is found according to the color 
combination rule of Table 1 (step 211). Thereby, a well-organized pattern with high 
resolution is accomplished. 

25 FIG. 3 illustrates a 3D image acquisition method according to an embodiment of the 

invention. A common light source and a pattern light source are respectively used to acquire 
a texture image and a pattern image (step 301 ). The projected image, which is acquired by the 
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common light source, is used to analyze the color composition of an object (step 302). The 
pattern image, which is acquired by the pattern light source, is used for location calculation 
by boundary detection (step 303). 

FIG. 4 illustrates the location calculation process of the pattern image by boundary 
5 detection. The pattern image is mapped to coordinates (step 401) to separate hues and color 
brightness, for example. In order to reduce noise influence on the image boundary detection, 
the image is required to pass through a low-pass filter (step 402). Each scanning line from the 
low-pass filter has a YIQ value consisting of Y(x), I(x) and Q(x). After the scanning line has 
passed the low-pass filter, the YIQ value changes to be respectively: Yl(x) = L(x)* Y(x), Il(x) 

10 = L(x)*I(x), and Ql(x) = (L(x)*Q(x), wherein * is a convolution and L(x)= [1, 2, 3, 2, 1]. 
Then, gradation detection is performed (step 403) to obtain Ygl(x)=G(x)*YL(x), Igl(x) = 
G(x)*IL, Qgl(x) = G(x)*QL(x), wherein G(x) = [-2,-1,0,1,2]. Absolute values of Ygl(x) = 
G(x)*YL(x), Igl(x) = G(x)*IL, Qgl(x) = G(x)*QL(x), respectively, are calculated. These 
absolute values are summed up (E(x) = abs(YGt(x)) + abs(lGL(x)) + abs(QGL(x)), and the 

15 resulting E(x) value to [0,1] is normalized to obtain the result of FIG. 5. A peak 505 is 
defined as a boundary line and a trough 506 is defined as a central line. 

Sub-pixel precision can be further performed for this system. If there is a peak 510 
between two troughs 508, 509 without further sub-pixel precision operation, then the number 
5 1 0 is the maximum integer. A center of gravity position 5 1 1 of sub-pixels can be calculated 
20 by using the following equation to obtain correct positions of the color strips (step 404): 

E=l sX .f( X )d X /l i n X )d X 

The color of the pattern image then is determined (step 304). By using the mathematical 
25 calculation method as shown in FIG. 10, each pixel of the pattern image is referred to one of 
the six colors and is given [R, G, B] values. Each of the R, G, and B ranges from 0 to 255. 
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For example, if G is the smallest among the three values, then G is 0. Consequently, if R is 
greater than b, then R has the value 255. Finally, if B/R is greater than a critical value Th 
which is usually determined on the basis of experimental results (in this embodiment Th = 
0.7), then B has the value 255, otherwise B is 0. Any other mathematical calculation methods 
may be used to gauge the colors. 

Subsequently, the colors of the image are corrected (step 305). When the pattern is 
projected on an object made of a special material, (person visage or china), the colors of the 
pattern on the object vary, which increases the probability of erroneous evaluation. In order 
to solve such a problem, the mathematical calculation set forth above is provided 
accompanied with a correction step. 

Referring to FIG. 7, it is first determined whether the color is correctly evaluated (step 
701). Color correction is performed according to Table 2 and the definition of the cluster 
(step 702). 



Evaluated color 
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G 
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C 


M 


Y 


Possible color 


R 


G 


B 


B • C 


B » M G 


> C ' Y 


Amount of 
possibility 


1 


1 


1 


2 


2 


3 



Table 2 



For example: the color which evaluated as Yellow ,may be erroneously evaluated from 
Green or Cyan. In the case of a color strip that consists of 6 neighboring colors, the number of 
color combinations is about 36 colors, such as CMYBYB, BMYBYB or CBYBYB, among 
which only one is correct. Thereafter, the possibly correct color combinations are picked out. 
When one color strip is projected on the object, the color strip encoded according to the 
above-described way is located within a limited range. As shown in FIG. 9, one color strip 
located at 0.5 from a center of the pattern may be allowed to shift within 0.38 - 0.43 in pattern 
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image according to its depth. Thereby, any color strips located with the specific range can be 
referred to a nearby correct one. 

Correction of color strip encoding is performed at step 703. Referring to FIG. 11, each 
color strip is given a unique code, for example, STRIP 29 or STRIP 50. Most of the color 
5 strips can be correctly encoded, while some may be erroneously encoded. For example, two 
color strips STRIP 31 and STRIP 32 cannot find their corresponding locations, while there 
are two color strips lost between STRIP 30 and STRIP 32. It is confirmed that the lost strips 
must be STRIP 3 land STRIP 32. Furthermore, if there are 5 color strips lost between STRIP 
35 and STRIP 41 while it is found that STRIP 29 - STRIP 33 are wrongly encoded, then the 
10 lost color strips must be STRIP 36 - STRIP 40 because the codes of the color strips should 
increase progressively. The correction of the color strip encoding is repeatedly performed 
until all the color strips are correctly positioned (step 704). 

Data for the profile of the object are calculated (step 306) to obtain the 3D model of the 
object (step 307). 

1 5 The invention being thus described, it will be obvious that the same may be varied in 

many ways. Such variations are not to be regarded as a departure from the spirit and scope of 
the invention, and all such modifications as would be obvious to one skilled in the art are 
intended to be included within the scope of the following claims. 
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